NPRDC  TR  78-25 


July  1978 


EFFECTS  OF  ADMINISTRATIVE  POLICY 
ON  STUDENT  PERFORMANCE 


Macy  L.  Abrams 
Jane  Sachar 
Christine  Buckley 


Larry  J.  Brown 

Underway  Replenishment  School 
Naval  Technical  Training  Center 
Treasure  Island,  California 


Reviewed  by 
J.  J.  McGrath 


D D C 


fi 

r 

V AUG  23  1978 

Approved  by  J 

IkisEirou,! 

James  J.  Regan 

Technical  Director 

B 

Appror 

PU1 


iUTION  STATEMENT  A 


ApproT«d  for  public  kIsom; 
DUtrlbudoo  Unlimited 


Navy  Personnel  Research  and  Development  Center 
San  Diego,  California  92152 


UNCI. ASS  1 FI  Kl> 

SfcWRlTY  CLAUlMCATlQN  OP  THtt  < Dmtm  lm*«*0 

CFP)  REPORT  DOCUMENTATION  pace 


ll  OOVT  ACCElttON  NO. 


/npkik  ik 


« T i 1 i.  « I Mid  Sui.1111.)  _____ aM  / 

I EFFECTS  OK. ADMIN l STRATI VK  POLICY  ON  STUDENT  V 
PERFORMANCE  . 


AuTHonra) 


HEAD  INSTRUCTIONS 
BEFORE  COMPLETING  FORM 

» AEClPlENT't  CATALOG  NUMIH 


■Jin  o«  uroiuiuuu 

Technical  KepWt. 
June  rt  76-May  1077, 


|TAACT  on  OH  AN  T NUMAEA(a) 


flacv  /i\l> turns  p 

lane /Sac ha r^ 

1 peafoaming  onOANiJ 


Chr 1st Ine  /Buck  ley  . 
l.arrv  J./ Brown 


/ : Jf  *3$  : •<  - 


PnOOHAM  (LIMtHT,  PnojtCT.  TASK 
A AC  A A »0  AK  UNIT  NUMBERS 


Navy  Personnel  Research  and  Development  Center  f // 
San  Diego,  California  *>2152  (Code  106)  ^ 

O CONTnOLLINC  OFFlCt  N All  I AND  AOONEtt  ^ j j 1 

Navy  Personnel  Research  and  Development  Center 
San  Diego,  California  D21S2  (Code  106) 

n MONiTOAtNO  AOCMCV  NAMC  • AOOACSVIf  dllloronl  loom  Controlling  Olllco) 


kmyi  * —j 

ZF5^2^|Bi2f03.02 


July  IS 78 


UJ) 


u number  of  pages 


It  SECURITY  CLASS  |.>l  iMi  rtp.nl 


UNCLASSIFIED 

Its.  DECLASSIFICATION  ’OOWNG  a ADI  N G_ 
*C  HCOULE 


rr*  DISTRIBUTION  ST ATCMlAT  (ol  Ml*  ftap or!) 


Approved  for  public  release;  distribution  unlimited. 


[7t  DISTRIBUTION  STATEMENT  (ol  >A*  aAalrwcl  ontorod  In  BlacA  10.  1 1 dllloronl  Itom  Raporl) 


[ I*  SUPPL  EMtN  TAAV  NOTE! 


t|  KEY  WO  AOS  (Conllnuo  on  rovoroo  oldo  It  nocoooory  and  Idonllty  6 y block  ntmbor) 

School  admlnlst rat  Ion 
Academic  at  t r i t ion 
Student -teacher  inter. id  ion 


10  A 9ITAACT  (Conllnuo  an  roooooo  oldo  II  nocoooofr  ond  Idonllty  by  bloob  nt^bor) 

The  effects  of  two  tvpes  of  school  administrative  policy  on  Navy  student 
performance  were  investigated.  They  were  (1)  direct  Instructor-trainee 
interactions  with  a primary  stress  on  military  behaviors  and  a secondary 

a ^ flfV 

stress  on  academic  behaviors  (M  ),  and  (2)  Indirect  Instructor-trainee 
interactions  with  the  primary  emphasis  on  academic  behaviors  and  a secondary 

emphasis  on  military  behaviors  (Am) Subjects  were  111  students  attending 


DO  , 1473  COITION  OF  I NOV  «•  It  OBSOLETE 


UNC1ASS IKIED 

ECCUNlTY  tLAtilFlCATt&iF oV  ThII  PAOt  (Wbon  Dal*  Enlaradl 


5 /j  r/  ^ 


UNCLASSIFIED 

IICUWTY  classification  of  thi»  faq«<s»«n  D*m  fcwm 

a Navy  Hydraulics  course  with  three  classes  conducted  under  each  policy.  The 

Am  policy  treatment  significantly  reduced  attrition  and  improved  academic  per- 
formance. It  was  suggested  that  the  study  be  replicated  in  a different  school 

setting  or  that  the  A™  treatment  be  tried  out  in  one  or  more  schools.  If  the 
results  support  those  of  the  study,  it  is  recommended  that  the  Navy  implement 
this  policy  and  provide  administrators  with  a course  in  the  procedures  for 

establishing  and  maintaining  the  use  of  A™  methods. 


UNCLASSIFIED 


MCUftlTV  CLASSIFICATION  OF  THIS  PAOS^VAm  Dm  *»»•»•*) 


FORK WORD 


The  research  was  per formed  under  Kxplorntory  Development  Task  Aren 
ZKSS- ‘>22-002  (Methodology  lor  Development  anil  K valuation  ol  Navy  Training 
Programs)  and  Work  Unit  Number  ZF55-522-002-01. 02  (Comprehensive  Strategy 
tor  Reducing  Attrition  in  Navv  Tochnleal  Training  Schools).  It  was  initiated 
In  response  to  requests  from  the  Chiet  ot  Naval  Technical  Training. 

Appreciation  Is  expressed  to  the  staff  of  the  Underway  Replenishment 
School,  Treasure  Island,  who  worked  so  diligently  in  this  effort.  Special 
appreciation  Is  extended  to  LT  Foley,  MMC8  Dor  la,  KNCS  Puckett,  MMt'S  Mort, 

MMC  lmmamua,  and  MM1  Kschenko  for  their  enthusiastic  support  and  coopera- 
t Ion. 


J.  J.  CI.ARK  IN 
Commanding  Officer 


o u 


SUMMARY 


Problem 


Lgh  academic  attrition  rates  continue  to  be  of  prime  concern  to  the 
Navy  in  terms  of  higher  training  costs  and  the  resulting  shortages  of  criti- 
cal fleet  personnel.  Numerous  studies  have  been  conducted  on  the  effects 
of  trainee  characteristics,  course  content,  and  instructional  delivery 
systems  on  attrition.  However,  since  the  attrition  problem  continues,  it 
appears  that  research  should  be  conducted  on  school  administrative  policy. 

Ob  jectlve 

The  objective  of  this  research  was  to  investigate  the  effect  of  two  types 
of  school  administrative  policy  on  Navy  student  performance  across  experi- 
ence levels.  The  two  policies  studied  were  (1)  direct  instructor-trainee 
interactions  with  a primary  stress  on  military  behaviors  and  a secondary 

stress  on  academic  behaviors  (M  ),  and  (2)  indirect  instructor-trainee  inter- 
actions with  the  primary  emphasis  on  academic  behaviors  and  a secondary  em- 
phasis on  military  behaviors  (A™). 


Approach 

Subjects  were  151  students  attending  the  Underway  Replenishment  Mechanical 
and  Hydraulic  Components  Maintenance  course  conducted  at  the  Naval  Technical 
Training  Center,  Treasure  Island,  between  28  June  1976  and  25  February  1977. 
The  two  experimental  conditions  were  administrative  policy  favoring  the  use 
d m 

of  either  M or  A treatments.  Three  types  of  dependent  variables — academic 
performance  (attrition  and  scores  obtained),  military  performance,  and  atti- 
tude changes — were  measured  during  the  first  and  third  weeks  of  the  3-week 
course.  The  same  course  materials,  schedules,  and  instructors  were  used 

under  both  experimental  conditions.  The  M treatment  was  used  for  the  first 

three  classes;  and  the  Am  treatment,  for  the  final  three  classes.  Prior 
to  the  onset  of  each  condition,  the  administrator  and  instructors  were 
given  training  in  the  respective  conditions. 

Results 

1.  The  attrition  rate  for  A™  students  was  1.4  percent,  compared  to 
10.1  percent  for  M students. 

2.  Students'  academic  performance — for  both  theoretical  and  practical 
measures — was  significantly  improved  under  the  A™  treatment. 

3.  A significantly  higher  proportion  of  Ma  than  A™  students  committed 
infractions  for  the  "hair"  measure  of  military  performance  during  the  first 
week;  however,  both  groups  were  performing  at  the  desired  military  standards 
by  the  end  of  the  course. 

4.  In  end-of-course  interviews,  Am  students  were  considerably  more  posi- 

n 

tive  about  the  course  and  the  learning  environment  than  the  M students. 


Conclusions 


It  appears  that  Navy  training  attrition  rates  and  training  costs  could 
be  significantly  reduced  if  school  administrative  policies  favoring  the 
m 

use  of  the  A treatment  were  implemented. 

Rec  ommenda  t ions 


The  study  should  ideally  be  replicated  in  a different  school  setting 

or  the  Am  treatment  should  be  tried  experimentally  in  one  or  more  schools. 
If  the  results  support  those  of  this  study,  it  is  recommended  that  the 

A01  treatment  become  official  Navy  administrative  policy.  One  possible 
approach  to  implementing  this  policy  would  be  to  develop  a short  course 
for  school  administrators  that  would  provide  (1)  a step-by-step  procedure 

for  establishing  and  maintaining  the  use  of  Am  teaching  methods  and  (2) 
practice  with  those  methods.  The  costs  associated  with  the  development 
and  implementation  of  this  course  would  be  minimal  compared  with  the  cur- 
rent costs  of  attrition. 
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INTRODUCTION 


' ~ 


Problem 

In  an  endeavor  to  maximize  fleet  readiness,  the  Navy  expends  about  20  per- 
cent of  its  annual  personnel  investment  for  training  (Battelle,  Brown,  Kruzic, 
Marshall,  Moll,  Faskert,  & Radovie,  1*173).  Yet,  academic  attrition  rates 
are  often  high,  which  results  In  major  shortages  in  the  manpower  levels  of 
technical  ratings  required  in  the  fleet  (Chief  of  Naval  Technical  Training 
(CNTECHTRA),  Note  1).  Further,  the  performance  of  manv  graduates  is  often 
deemed  unsatisfactory.  The  Center  for  Naval  Analyses  (Lockman,  1975)  estimates 
that,  for  fiscal  vear  1975,  "the  attrition  cost  could  easily  exceed  100 
million  dollars,  and  this  would  not  take  into  account  the  costs  of  empty 
training  seats  and  fleet  billets"  (p.  2).  Therefore,  not  only  the  causes 
of  conditions  leading  to  academic  attrition,  but  also  the  correction  of 
such  conditions,  are  major  concerns  of  the  Navv  training  community  (Chief 
of  Naval  Education  and  Training  (CNKT),  Note  2;  CNTECHTRA,  Note  3). 

Some  factors  that  may  affect  academic  attrition  include  trainee  charac- 
teristics, course  content,  instructional  delivery  systems,  and  school  adminis- 
trative policy.  Considerable  research  has  been  conducted  on  the  first  three 
variables  (e.g.,  Abrams  & Wells,  1971;  Brock,  Wells,  & Abrams,  1974;  Thomas, 

E.,  1969;  Thomas,  P.,  1972;  Fishburne  & Mims,  1975),  with  varying  degrees  of 
success.  However,  since  the  attrition  problem  continues,  it  appears  that 
research  should  also  be  conducted  on  the  latter  variable,  administrative 
pol icy. 

Background 

According  to  Navy  School  Administration  (NAVPERS  10495,  1966),  the  basic 
purpose  of  educational  administration  is  to  constantlv  strive  for  "improved 
learning  so  as  to  provide  the  best  trained  manpower  possible  for  the  operat- 
ing forces"  (p.  iv).  The  officer-in-charge  of  a Navy  school  (the  administra- 
tor) serves  as  its  educational  leader,  providing  leadership,  guidance,  and 
appropriate  training  to  the  instructional  staff  members  to  stimulate  their 
development  as  teachers.  As  such,  the  administrator  must  work  with  and  guide 
the  teaching  staff  in  those  teaching  behaviors  essential  to  accomplishing 
the  school's  goals.  One  approach  to  analyzing  the  effectiveness  of  the 
administrator,  then,  is  to  evaluate  how  teaching  behaviors  affect  student 
performance. 

In  the  public  school  sector,  the  relationship  between  teaching  behaviors 
and  student  performance  has  been  studied  by  observing  teacher-student  inter- 
actional behavior.  In  most  of  these  studies,  two  contrasting  teaching  styles 
have  been  identified,  commonly  labelled  as  the  indirect  and  direct  methods.1 
The  concept  and  findings  of  these  studies  consistently  Indicate  that  indirect 
styles  or  behaviors  are  usually  associated  with  improvement  in  academic  per- 
formance. Teachers  using  these  behaviors  tend  to  encourage  student  verbal 
participation  by  accepting  and  supporting  their  ideas  anil  feelings,  by  praising 


'other  labels  assigned  to  these  styles  in  various  studies  include  (1) 
permission-directive,  (2)  integrative-dominative,  and  (3)  inclusive-preclu- 
sive. 


1 


1 


and  encouraging  their  questions  and  responses,  and  by  asking  questions  to 
stimulate  their  participation  and  interest  in  schoolwork.  On  the  other 
hand,  teachers  vising  direct  behaviors  tend  to  restrict  student  verbal 
participation  by  expressing  their  own  ideas,  bv  giving  rders,  bv  criticizing 
student  behavior  in  an  attempt  to  change  it,  and  by  justifying  their  authority. 
These  latter  behaviors  are  usually  considered  essential  to  the  effective 
management  of  military  establishments,  including  school  operation  (e.g, 
c'NTECHTRA,  Note  4). 

Results  of  some  of  the  studies  performed  in  the  public  school  sector  are 
provided  below: 

1.  Amidon  and  Flanders  (I9t>l)  experimentally  controlled  the  teaching 
patterns  by  training  a teacher  to  perform  the  appropriate  behaviors  in  four 
experimental  conditions — two  using  indirect  methods;  and  two,  direct.  The 
teaching  variable  was  manipulated  during  a 15-minute  discussion  presented 
by  the  teacher  on  basic  concepts  in  geometry.  Results  showed  that  students 
in  the  indirect  conditions  learned  considerably  more  than  those  in  the 
direct  conditions. 

2.  Flanders  (1967)  studied  students  in  eighth-grade  matheraat ics  and 
seventh-grade  social  studies  courses.  Those  assigned  to  classes  where 
teachers  used  indirect  methods  achieved  significantly  more  than  those 
assigned  to  classes  where  teachers  used  direct  methods.  Before  these  students 
began  the  course  and  after  they  had  completed  it,  they  were  surveyed  to 
obtain  their  attitudes  toward  and  perceptions  of  the  teachers,  class,  and 
learning  activities.  Results  showed  that  students  who  had  teachers  who  used 
indirect  methods  had  the  most  constructive  and  independent  attitudes. 

J.  LaShier  (Note  5)  studied  the  interactional  behaviors  of  10  eighth- 
grade  student  teachers  over  a 6-week  period.  He  computed  ratios  of  indirect 
to  direct  behaviors  for  each  teacher  and  found  a significantly  positive  rela- 
tionship between  these  ratios  and  student  performance  on  a reading  test. 

4.  Snider  (Note  6)  observed  high  school  physics  teachers  over  a 1-year 
period  and,  like  LaShier,  computed  ratios  of  Indirect  to  direct  behaviors 
for  each  teacher.  The  academic  achievement  of  their  students  was  measured 
bv  the  scores  they  obtained  on  three  science  tests  during  the  year.  In  this 
study,  neither  direct  nor  indirect  behavior  was  related  to  student  achieve- 
ment across  all  measures;  however,  students  who  had  teachers  who  were  more 
direct  during  lectures  and  who  had  smaller  variations  in  their  ratios  of  in- 
direct vs.  direct  behaviors  across  various  classroom  activities  performed 
significantly  better  than  other  students.  This  finding  suggests  that  the 
consistency  of  a teacher's  behavior  may  be  just  as  important  to  student 
achievement  as  the  type  of  interactional  behavior  used. 

In  summary,  the  results  of  the  majority  of  these  studies  indicated  that 
the  use  of  indirect  teaching  behaviors,  particularly  the  use  of  praise  and 
encouragement,  which  is  one  aspect  of  indirect  teaching,  tended  to  be  related 
to  higher  student  test  scores. 

Because  the  military  environment  differs  from  the  public  school  environ- 
ment, the  results  of  public  school  research  cannot  be  uncritically  generalized 
to  Navy  schools.  There  is  no  available  Navy  research  pertaining  to  teacher- 
trainee  interactions;  however,  there  is  some  evidence  concerning  the  effects 
of  differing  administrative  policies. 


Bor  example,  re  son  rch  dealing  wltli  the  application  of  instructional 
design  systems  in  the  Navv  (Rundqulst,  Brock,  f«  Abrams,  1 Q 7 .’ ) found  that 
differences  in  school  administrative  policies  might  have  a strong  impact 
on  student  performance.  However,  the  other  Navv  research  previouslv  cited 
looked  at  behaviors  that  teachers  displayed  independent  of  administrative 
policy;  thus,  it  appears  that  future  research  should  address  the  question 
of  whether  administrative  policy,  which  specifies  those  teacher  behaviors, 
can  affect  student  performance. 

A comparison  of  1976  academic  attrition  rates  for  5063  trainees  in 
four  ratings  attending  Basic  Electricity  and  Electronics  schools^  at  Great 
Lakes,  San  Diego,  and  Orlando  provided  additional  evidence  suggesting  that 
administrative  policies  in  Navv  schools  may  affect  performance  and  academic 
attrition.  Trainee  characteristics,  course  content,  and  instructional  de- 
liverv  svstems  were  nearly  identical  across  schools.  However,  as  shown 
in  Table  1,  there  were  significant  differences  in  attrition  rates  in  three 
of  the  four  ratings  (e.g.,  for  the  GMG  rating,  attrition  rates  were  46,  32, 
and  14  percent  .it  Great  Lakes,  San  Diego,  and  Orlando  respectively).  Since 
the  other  variables  were  constant,  the  differences  among  attrition  rates 
may  have  resulted  from  different  administrative  policies. 


The  objective  of  this  research  was  to  investigate  the  effects  of 
school  administrative  policy  on  Navy  student  performance  across  experi- 
ence levels.  The  two  policies  studied  were  (1)  direct  instructor-trainee 
interactions  with  a primary  stress  on  military  behaviors  and  a secondary 

stress  on  academic  behaviors  (Ma),  and  (2)  indirect  instructor-trainee 
interactions  with  the  primary  emphasis  on  academic  behaviors  and  a secondary 

emphasis  on  military  behaviors  (Am) . It  was  hypothesized  that  an  administra- 
tive policy  requiring  instructors  to  use  the  A™  treatment  would  result  in 
superior  academic  performance  and  comparable  military  performance. 


« 


Navy  recruits  in  approximately  17  different  ratings  must  pass  through 
BE/E  school  before  they  can  attend  their  respective  "A"  schools. 
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Academic  Attrition  Rates  for  Selected 
Ratings  in  BE/E  Schools,  January-July  1976 
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sing  aoa.lotiiio  t oipi  1 1 omont  s III -it,  anil  mllltatv  t oipi  1 1 1'liiont  s sovoml ) . I'ho 

M*  gt  oup  I tti'  1 till  i'il  .’0  olvlll.tns,  ' olili't  pot  t v ott  loots,  I.’  I Its!  olass  pot  t v 
oil  loot's,  '*  sooottil  olass  pot  I v ol  I loot  ti,  11  t It  I t il  olass  pot  t v ol  t loot  n,  ami 

t It  onion 'soamon.  I’ho  A*"  |tt  onp  Inoliiilo.l  1.’  olvlllans,  I ohtot  watt  ant 
ott  loot,  ’ ohlot  pot  tv  oil  loots,  ll'  I list  olass  pot  t v oil  loots,  I.'  si'oonil 
.lass  pot  t v oltloots.  It'  I h 1 1 il  olass  pot  t v ollloots,  attil  I '•  I I ronton/ soamon  . 

I’ho  .1 1 1 t ot  otioi's  In  group  oomposlt  Ion  wot  o hovoml  tho  t osoat'vhor  s 1 vontrol; 
t hov  oooutti'il  as  a tunotlon  ot  how  potsonnol  at  o not  ma  1 1 v asslgnoil  to  tho 
sohoi’l.  Ilowovot  , In  tho  pluvious  olassos  liol.l  In  KY  '<>,  wliloh  iuoltnloil  It'S 
stiiilouts,  p«'t  sonno  l olassll  'oat  Ion  was  not  s I gn  1 1 loan!  lv  tolato.l  to  aoailomlo 
aoh I ov omont . 

I’t  OOOilllt  o 

I'ho  liitlopouilont  vat  lahlo  was  tho  a.lmlii  I st  t at  ot  's  .lltoot  Ions  to  tho  lustruv- 

t ot  s to  uso  oltliot  tho  a'"  oi  M'1  tioatmont.  I’ho  .lopon.lont  vat  lahlo*  wot  i* 
aoailomlo  pot  t ot  ntattoo , mllltatv  poitotmanoo,  an. I attltmlos,  moasutoil  Jin  tun 
tho  lltst  an. I thtr.l  wooks  ol  tin'  oout  no. 

Aoa.lomlo  potlormanoo  was  nti'asuroil  hv  (|)  attiltlon  talon,  ( .' ) wooklv 
wt  1 1 t on  tosts  (At)  mult  Iplo  olioioo  Itoms),  ( U sutntni'.l  htvooklv  wt  1 1 t on  pro 
gt  oss  tosts  tit'  mu  1 1 1 p I o oho  loo  Itoms  pot  tost),  ami  (s)  wooklv  pot  lotmanoo 
tosts.  In  tho  pot  lotmanoo  tost  glvon  .lut  lug  tho  lltst  wook,  tho  tratnoo 
ha. I to  assonthlo  ami  .1 1 sassi-ltth  1 o tho  Vlokots  Vano  rump;  ho  was  gt  a.lo.t  on  Ills 
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skill  In  d tsassemblv  and  assembly  and  on  whether  the  pump  operated  correctly 
when  assembled.  In  the  performance  test  given  during  the  third  week,  the 
trainee  had  to  design  a schematic  for  a hydraulic  system  using  a specified 
number  of  components  performing  designated  operations;  he  was  graded  on  the 
number  of  components  used,  their  placement,  and  whether  the  system  would 
work . 

Military  performance  was  measured  several  times  per  week  by  personnel 
Inspections  and  barracks  Inspections.  For  the  former,  a dichotomous  score 
was  coded  for  each  of  the  four  measures — uniform,  hair,  shoes,  and  shave — 
Indicating  whether  the  student  had  committed  any  Infractions  in  the  first 
three  and/or  the  last  three  personnel  Inspections.  Civilians,  the  chief 
warrant  officer,  and  the  chiet  petty  officers  were  exempt  from  personnel 
Inspect  ions . 

Attitudes  were  measured  by  13  survey  items  given  before  students  began 
the  class  and  after  they  completed  It  (see  appendix).  In  addition,  available 
Basic  Test  Batterv  scores  were  collected. 

Before  the  experiment  began,  the  school  administrator  and  his  staff  met 
with  the  researchers  and  |olntlv  determined  the  experimental  conditions. 

The  conditions  remaining  constant  for  the  M'*  and  Am  groups  are  listed  below. 
Those  that  varied  according  to  group  are  shown  in  Table  2. 

L.  Curriculum. 

a.  Course  content. 

b.  Classroom  schedule  (hours). 

c.  Textual  materials. 

d.  Handouts  (e.g.,  on  school  policy  and  regulations), 

e.  Homework. 

f . Te  s t s . 

2.  Instructional  delivery  systems  (e.g.,  lecture,  lab). 

1.  Military  and  academic  standards. 

4.  Instructors. 

5.  Staff  organization. 

b.  Debriefing  procedures. 

7.  Records. 

a.  Results  of  barracks  and  personnel  inspections  and  military  action 
taken . 

h.  Scores  obtained  on  academic  tests  and  remediation  taken. 

c.  Scores  obtained  on  attitude  survey  questionnaires. 

d.  Personnel  data  (e.g.,  BTB  scores  obtained). 


Table  2 


F.xper  Imental  Conditions  thut  Varied  According  to  Group 


It  SOI 

Procedure  for  M*  Croup 

Procedure  for  A*  Group 

Opening  Orientation 

Kaphas  t s 

Military  requirements  first, 
academic  requirements  second. 

Academic  requirements  first, 
military  requirements  second. 

Inspect  ions 

Personnel 

Formal  muster  In  format  Ion  outside  class- 
room. 

Informal  muster  in  classroom. 

Hat  racks 

Forma l--severa 1 times  weekly. 

Informal — several  times  weekly. 

Classroom  Environment 

Initial  greeting 

Reward  student  for  proper  military  appear- 
ance/action and  formally  admonish  for 
Infractions  committed. 

Show  concern  for  Individual  academic 
progress;  mention  informally  the 
obvious  need  to  look  and  act 
militarily;  discuss  infractions 
privately. 

Inst  rue tor /student 
Int  erect  Ion 

Instructor  to  he  addr eased  formally. 

Instructor  to  be  addressed  informally. 

i}uest  Ions 

Not  encouraged;  student  must  raise  hand 
and  wait  to  he  called  on.  Roth  student 
questions  and  student  answers  to  ques- 
tions treated  factually. 

Involvement  bv  all  students  encouraged; 
questions  permitted  without  raising 
hand.  Student  always  reinforced  for 
any  part  of  question  answered  cor- 
rectly— recognised  for  whatever  he 
did  correctly. 

S*  hedule 

Adhere  rigidly  to  schedule. 

Make  schedule  sufficiently  flexible 
to  meet  learning  needs. 

Tests  and  homework 

assignments 

Papers  returned;  grades  given;  tests  re- 
viewed with  minimum  amount  of  dtscusslon 
anti  advice  to  study  weak  areas. 

Papers  returned;  grades  given;  tests 
reviewed  thoroughly  and  students 
recognised  for  what  they  did  well. 

Test  results  used  as  learning  tool, 
with  weaknesses  treated  In  positive 
manner.  Individual  remediation  re- 
commended . 

Rewards  le.g., 

Friday  PM  off) 

Haaed  on  military  excellence. 

Haaed  on  academic  excellence. 

Staff  Meet ings/Direct Ion 

Focus 

Toward  techniques  for  better  adherence 
to  military  regulations. 

Toward  techniques  to  enhance/motivate 
student  learning— "Now  can  we  reach 

so  snd  so?” 


For  both  M‘*  and  A™  subjects,  the  primary  concern  was  student  per- 
formance, including  both  academic  learning  and  military  deportment.  How- 
ever, as  shown  In  Table  2,  the  procedures  used  for  attaining  this  perfor- 
mance varied  considerably.  For  example,  during  the  opening  orientation, 
in  which  course  conditions  were  established,  t he  presentations  differed 
In  the  manner  in  which  topics  were  covered.  In  the  emphasis  placed  on  them, 

and  In  the  amount  of  time  spent  on  them.  For  the  Ma  group,  the  presentation 
stressed  military  rules  and  regulations.  Students  were  told  what  they 
wore  required  to  do  and  what  they  could  not  do.  They  were  given  a schedule 
of  personnel  and  barracks  inspections  and  told  that  their  appearance  would 
have  t o meet  prescribed  military  regulations.  With  regard  to  academic 
requirements,  they  were  given  the  criteria  for  a passing  grade  and  told 
that  they  were  expected  to  do  well  and  that  their  instructors  would  help 
them  It  they  got  behind  In  their  homework.  All  statements  were  delivered 
In  a very  direct  fashion,  emphasizing  do's  and  do  not's. 


The  orientation  of  the  A*"  group  was  much  more  relaxed.  The  students 
were  told  that  Inspections  would  occur  and  that,  since  they  were  all  adults, 
they  knew  what  was  expected  of  them.  With  regard  to  academic  requirements, 
students  were  told  that  the  major  reason  people  dropped  out  or  failed  the 
course  was  because  ot  a lack  of  Interest;  therefore.  It  they  were  interested 
in  the  course,  they  would  pass.  Finally,  they  were  told  that  the  instructors 
would  be  available  to  help  with  any  course-related  problems. 


Table  2 also  shows  that  the  M*  group  operated  in  a more  formal  environ- 
ment than  the  A1"  group.  For  example,  when  each  class  began,  M‘*  students 
wore  greeted  either  with  praise  for  their  military  excellence  or  admonishment 
tor  infractions  they  had  committed.  Student  questions  were  not  encouraged, 
but  both  their  questions  and  answers  were  treated  factually.  Conversely, 

A*"  students  wore  greeted  bv  comments  expressing  the  instructor's  concern 
for  and  desire  to  assist  In  their  academic  progress;  anv  military  infrac- 
tions they  had  committed  were  always  discussed  privately  during  a break  or 
after  class.  These  students  were  urged  to  ask  questions,  and  told  that 
"there  Is  no  such  thing  as  a dumb  question."  The  Instructor  always  responded 
positively  to  their  questions,  and  students  were  always  reinforced  for  anv 
part  of  a question  answered  correctly. 

As  indicated  previously,  M‘*  teaching  patterns  were  used  for  the  three 

consecutive  classes  running  from  28  dune  to  24  September  117b;  and  A™  teach- 
ing methods,  for  the  three  classes  running  from  IS  November  1 1 7 h to  2S  February 
1177.  Before  the  beginning  of  the  experiment,  the  instructors  were  given  a 
listing  ot  the  experimental  conditions  that  were  to  remain  constant  for  both 
groups  and  those  that  would  vary  11. e. , procedures  used).  Also,  before 
commencing  each  teaching  pattern,  the  administrator  and  the  instructor  were 
given  Intensive  training  in  use  of  that  pattern.  Further,  to  ensure  that 
the  experiment  was  conducted  as  designed,  a researcher  Interviewed  all  trainees 
upon  course  completion. 
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RESULTS 


There  were  three  nonacademic  drops — one  M'1  subject  ami  two  Am  subjects — 
during  the  course  of  the  experiment.  Thus,  the  final  sample  consisted  of 

79  Ma  subjects  and  69  Am  subjects.  As  shown  in  Table  J,  there  were  no  sig- 
nificant differences  between  the  groups  on  the  Basic  Test  Battery  scores. 


Table  3 


Basic  Test 


Battery  Scores 


for 


Ma  and 


Groups 


Subt est 

M (..roup 

A Group 

t -value 

N 

X 

SO 

N 

X 

RD 

GCT 

47 

56.2 

8.0 

32 

53.2 

7.5 

1.71 

ARl 

47 

52.7 

7.6 

32 

51.6 

9.1 

.56 

MECH 

47 

54.2 

6. 8 

32 

51.9 

6.3 

1.52 

SHOP 

41 

55.4 

7.5 

24 

58.5 

6.8 

1.71 

Academic  Performance 


Attrition  Rates 

Figure  1 shows  that  the  attrition  rate  for  A™  students  (1.4X1  was 

significantly  lower  than  that  for  M‘*  students  (10.  IX,  t ■ 2.20,  p *■  .05). 

The  similarity  of  the  attrition  rates  for  M*  and  previous  1976  students 

(9.0X1  shows  that  the  introduction  of  the  M treatment  did  not  artificially 
raise  the  attrition  rate. 

One  objective  of  this  study  was  to  determine  whether  the  experimental 
treatments  had  different  effects  on  the  attrition  of  experienced  and  inexperi- 
enced personnel.  However,  the  sample  sizes  were  too  small  to  permit  a meaning- 
ful comparison. 
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Academic  Per  t o r wane e Scores 

The  means,  medians,  and  standard  deviations  of  the  academic  per- 
formance scores  of  the  two  groups  are  given  in  Table  A.  The  differences 
between  groups  are  shown  graphically  in  Figures  2,  3,  and  A. 

The  mean  scores  obtained  by  the  two  groups  on  the  weeklv  tests  (see 
Figure  2)  were  analyzed  using  a two-tailed  t-test.  Results  showed  that  the 
m . 

A group  pertornu'd  significantly  better  than  the  M group  in  both  the  first 
week  (t  - 3.07,  p ^ .01)  and  the  third  week  (t  - 2.3l>,  p - .05).  Thus,  the 

AU  group  was  superior  to  the  Ma  group  in  understanding  the  academic  content 
of  the  course. 

Table  A 

f 

Academic  Performance  Measures 


— 

Variab le 

Ma  Group 

Am  Group 

Mean 

Score 

Med  ian 
Score 

SO 

Mean 

Score 

Median 

Score 

SD 

Weekly  Test: 

Week  1 

81.3 

82.8 

11.9 

87.  1 

89.7 

10.5 

Week  3 

72. A 

70. A 

10.0 

76.8 

78.5 

11.6 

Biweeklv  Progress 

Test : 

Week  1 

17.5 

18.1 

2.3 

16.8 

17.0 

2 2 

Week  3 

16.1 

16.5 

2. A 

17. A 

17. A 

2.2 

Performance  Test: 

Week  1 

28.0 

29.3 

3.3 

29.7 

30.0 

1.2 

Week  3 

25.9 

27.9 

5.3 

29.7 

30.0 

.6 

Since  the  distributions  of  scores  on  the  biweekly  progress  tests 
(Figure  3)  were  skewed,  a parametric  test  on  means  was  inappropriate. 
Therefore  a nonparametr ic  test  (Wilcoxen  sum  rank)  was  used  to  test  group 

median  differences.  In  the  first  week,  the  Ma  group  had  a higher  median 
score  than  the  Am  group,  but  the  difference  was  not  statistically  significant 
(W*  = 1.93).  In  the  third  week,  a reversal  occurred,  and  the  Am  group  per- 
formed significantly  better  than  the  Ma  group  (W*  ■ 2.98,  p < .01). 

On  the  performance  tests,  the  majority  of  students  in  the  Am  group 
attained  the  maximum  score  of  30  points  (see  Figure  4),  producing  what  is 
commonly  called  a "ceiling  effect"  on  this  dependent  measure.  Since  a 
ceiling  effect  constrains  the  mean,  differences  between  central-tendency 
measures  cannot  be  assessed  meaningfully.  Therefore,  t-tests  were  made  at 

each  score  level  (30,  29,  28,  etc.)  within  the  range  attained  by  the  Am 
group,  testing  whether  the  proportion  of  subjects  scoring  at  or  above  that 
level  was  the  same  for  the  two  groups.  Results  showed  that  a significantly 

larger  proportion  of  Am  students  than  Ma  students  scored  at  or  above  every 

level  in  both  the  first  and  third  weeks  of  the  course.  Thus,  the  Am  group 

was  superior  to  the  M group  in  performing  practical,  hands-on,  job-related 
tasks. 


Military  Performance 


Results  of  the  series  of  three  personnel  inspections  held  during  the 
first  week  of  training  showed  that  a significantly  larger  proportion  of 

Ma  subjects  than  Am  subjects  committed  infractions  for  "hair."  Few  students 
in  either  group  committed  infractions  for  the  other  three  measures  (uniform, 
shoes,  shave);  and  there  were  no  significant  differences  on  these  variables 
between  groups. 

Results  of  the  series  of  personnel  inspections  held  during  the  third 
a m 

week  showed  that  no  M subjects  and  only  three  A subjects  committed  infrac- 
tions in  any  of  the  measures.  Thus,  both  groups  were  generally  performing 
at  the  desired  military  standards  bv  the  end  of  the  course. 

Some  barracks  inspection  results  were  contaminated  by  base  orders  requir- 
ing students  to  move  to  different  barracks  during  the  course  of  the  experi- 
ment. Therefore,  barracks  inspection  data  could  not  be  interpreted  meaning- 
fully. However,  both  groups  appeared  to  be  performing  at  an  acceptable  level 
throughout  the  experiment. 

Attitude  Changes 


Student  attitudes,  as  measured  by  the  13  survey  items  shown  in  the  appen- 
dix, changed  between  the  two  administrations.  However,  the  direction  and 
magnitude  of  the  changes  on  all  13  attitude  variables  were  the  same  for  the 
two  treatment  groups.  In  spite  of  these  survey  findings,  the  students  in  the 
two  groups  expressed  quite  different  attitudes  during  end-of-course  inter- 
views . 
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During  those  interviews,  A subjects  were  considerably  more  positive 

about  the  course  and  the  learning  environment  than  the  M‘*  students.  Typical 

comments  from  Am  subjects  Included:  "1  reallv  felt  like  studying,"  "Better 
than  any  other  Navv  school  I've  been  to,"  and  "We  got  so  involved  that  we 

formed  our  own  study  groups  in  our  off-hours."  In  contrast,  Ma  subjects 
generally  commented  that  the  school,  like  other  Navv  schools,  was  too  con- 
cerned with  military  regulations.  The  questionnaire  items  measured  general 
attitudes  toward  the  Navy;  thus,  the  comments  expressed  In  end— of— course 
Interviews  were  apparently  specific  to  the  school  and  not  to  the  Navv. 


DISCUSSION  AND  CONCLUSION 


l'he  basic  purpose  of  this  research  was  to  Investigate  the  effects  of 
administrative  policy  on  student  performance,  as  character ized  by  two  con- 
trasting instructor-trainee  interaction  patterns.  To  ensure  that  anv  dif- 
ferences in  student  performance  could  be  attributed  to  the  interaction 
patterns,  the  same  course  materials,  schedules,  instructors,  and  trainee 
input  were  used  under  both  experimental  conditions.  The  results  of  the 

study  support  the  hypotheses  that  the  Am  treatment  would  result  in  superior 
academic  performance  and  comparable  military  performance. 

I'he  combined  effect  of  a reduced  attrition  rate  and  improved  academic 
performance  scores  (at  no  measurable  cost  in  military  deportment)  is  of  the 
utmost  importance.  Attrition  occurs  when  students  fail  to  achieve  minimum 
academic  scores.  Thus,  the  simplest  way  to  reduce  attrition  obviously 
would  be  to  improve  academic  performance  scores  just  enough  to  meet  the 

minimum  level.  If  that  had  resulted  from  using  the  Am  treatment  in  this 
studv,  the  performance  of  students  who  otherwise  would  have  failed  would 
have  improved  sufficiently  to  pass,  causing  a lower  mean  performance  score 

for  the  entire  group.  The  fact  that  the  A™  group  had  both  significantly 
lower  attrition  and  better  academic  performance  scores  in  this  experiment 

indicates  that  the  \m  teaching  method  was  indeed  more  successful  in  pro- 
viding the  fleet  with  a greater  number  of,  as  well  as  better  trained, 
graduates . 

While  performance  was  generally  superior  for  the  A group,  test  results 
on  two  of  the  academic  performance  measures  require  further  explanation. 

First,  the  A group  scored  slightly  lower,  although  not  signif icantlv  so, 

than  the  >f*  group  on  the  biweekly  progress  tests  given  in  the  first  week. 
This  could  either  bo  due  to  chance  or  because  the  tests  were  given  early 
in  the  week,  perhaps  before  the  treatment  conditions  could  affect  student 
performance.  Second,  an  inspection  of  the  weekly  tost  results  indicated 
that  performance  declined  for  both  groups  during  the  third  week.  However, 
from  discussions  conducted  with  the  instructors,  it  appears  that  the 
students  were  performing  better  during  the  third  week,  and  that  the  decre- 
ment in  test  scores  was  essentially  a function  of  the  different  levels  of 
difficulty  of  the  tests  used. 

The  question  is  whether  the  results  of  this  study  can  he  generalized 
to  other  Navy  schools,  especially  other  technical  schools.  These  schools 
usually  differ  on  two  broad  dimensions  that  rn.iv  greatlv  impact  student  per- 
formance: type  of  subject  matter  (theory  vs.  practical  performance)  and 

student  input  (f leet/experlenced  vs.  recruit/inexperienced). 

Regarding  subject  matter,  theoretical  knowledge  was  measured  by  the 
progress  and  weekly  tests;  and  practical  performance,  bv  performance  tests. 

Results  showed  that  performance  of  Am  subjects  was  significantly  better 

than  that  of  Ma  subjects  on  both  types  of  subject  matter. 
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The  question  of  whether  the  A™  method  would  be  equally  effective  regard- 
less of  the  experience  level  of  the  student  inpu-.  i ould  not  be  answered  in 
this  study  since  the  groups  were  too  small  in  numbers  to  determine  a pos- 
sible interaction  between  experience  level  and  treatment.  However,  even 
though  statistical  analyses  were  not  warranted,  the  data  were  examined  for 
any  obvious  trend.  In  general,  there  were  no  trends,  and  all  experience 

levels  seemed  to  have  benefited  from  the  Am  treatment. 

To  summarize.  In  the  Am  condition,  subjects  as  a whole  performed  signi- 
ficantly better  on  both  types  of  subject  matter.  In  addition,  in  research 

conducted  in  the  public  school  sector,  it  has  generally  been  found  that  Am 
teaching  methods  do  result  in  better  performance  for  students  in  various 
grade  levels  learning  a variety  of  subjects.  Thus,  it  would  appear  that  the 
results  of  this  study  can  be  generalized  to  other  Navy  technical  schools. 


K Kl’OMMKNUAT  IONS 


School  ailmln  1st  rat  i vo  policy  favoring  the  Am  treatment  was  found  to 
contribute  to  lower  attrition  rates  and  improved  academic  performance. 

Yet,  current  Navv  schools  are  usually  conducted  using  the  M-*  treatment. 
Because  the  administrators  come  from  an  environment  stressing  operational 
military  behaviors,  they  may  tend  to  use  similar  operational  strategies  in 
administering  their  schools.  In  addition,  administrators  are  not  provided 

with  instruction  on  the  procedures  for  implementing  A teaching  methods  or, 
for  that  matter,  anv  instruction  on  school  administration.  For  this  par- 
ticular course,  it  took  approximately  2 weeks  to  train  the  administrator 

and  staff  on  the  proper  use  of  A™  teaching  methods.  The  training  was  largely 
experiential,  consisting  of  role  playing  and  discussion  of  the  behaviors 
identified  in  Table  2.  It  should  be  noted  that  the  administrator  and  staff 
stated  that  the  experiential  nature  of  the  training  assisted  them  immeasur- 
ably in  acquiring  the  ability  to  use  a'  methods.  Although  the  instructors 

had  attended  lectures  on  Am  methods  in  their  instructor  school,  they  were 
not  able  to  use  the  concept  without  the  role-playing  experiences. 

For  these  reasons,  it  is  recommended  that  the  study  should  be  replicated 

in  a different  school  setting  or  the  Am  method  should  be  tried  in  one  or  more 

schools.  If  results  support  those  of  this  study,  it  is  recommended  that  Am 
teaching  methods  become  official  Navy  administrative  policy.  One  possible 
approach  to  implementing  this  policy  would  be  to  develop  a short  course  for 
school  administrators  that  would  provide  (1)  a step-bv-step  procedure  for 

establishing  and  maintaining  the  use  of  Am  teaching  methods  and  (2)  practice 
with  those  methods.  The  costs  associated  with  the  development  and  implemen- 
tation of  t li  i s course  would  be  minimal  compared  with  the  current  costs  of 
at  t r i t i on . 
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ATTITUDE  SURVEY  QUESTIONNAIRE 


1.  At  the  present  time,  what  are  your  Navy  service  plans? 

a.  Serve  my  tour  of  duty  and  not  reenlist. 

b.  I am  undecided. 

c.  Reenlist  or  extend  one  or  more  times. 

d.  Stay  on  active  duty  until  retirement. 

2.  How  much  do  you  like  Navy  life  in  general? 


a.  Like  a lot. 

b.  Like  a little. 

c.  Not  sure. 

ii . Disl  ike  a little, 

e.  Dislike  a lot . 


J.  At  present,  how  confident  do  you  feel  about  handling  your  job 
duties  in  the  Navv? 


a.  Confident,  1 can  handle  any  demands  put  on  me. 

b.  Confident,  I can  meet  most  demands. 

c.  I do  not  feel  confident  at  all. 

d.  I do  not  think  about  these  things  very  much. 


What  do  you  think  of  the  following  areas  of  Navy  life?  Make  one  choice  from 
the  list  below  (A-D)  which  tells  what  you  think  of  the  area  mentioned.  Circle 
your  choice  below. 


4.  The  Navy's  system  for  promoting  men. 

A.  Does  not  apply  or  have  not  needed  any. 

B.  I am  satisfied  with  it. 

C.  1 am  dissatisfied  with  it. 

D.  No  opinion. 

For  each  statement  (Items  16-24),  make  one  choice  from  the  list  below  (A-F.) 
which  tells  what  vou  think  about  that  statement.  Record  your  choice  on  the 
blank  following  the  statement. 


A.  Agree  very  much. 

B.  Agree  a little. 

C.  Neither  agree  nor  disagree. 

D.  Disagree  a little. 

E.  Disagree  verv  much. 

5.  The  Navy  hardly  cares  about  how  well  each  man  in  the  Navy 
is  get  t ing  a long. 

The  Navv  gives  a man  the  chance  to  show  how  much  he  can  do. 
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7.  The  Navy  is  such  a large  organization  that  a man  gets  to 
feel  that  no  one  cares  about  him. 

8.  The  Navy  makes  sure  to  train  each  man  to  do  a good  job 
no  matter  what  his  assignment  is. 

9.  The  Navy  cares  more  about  rules  and  regulations  than 
it  does  about  training  a man  for  his  job. 

10.  I believe  that  being  in  the  Navy  lias  already  done  me  a 
lot  of  good. 

11.  The  Navy  is  really  a place  for  people  who  like  to  be  told 
what  to  do. 

12.  The  Navy  does  everything  it  can  to  put  men  in  jobs  for 
which  they  are  suited. 

13.  The  Navy  should  not  try  to  change  the  way  a man  thinks  or 
what  he  does,  as  long  as  he  does  the  job  to  which  he  has 
been  assigned  and  does  not  get  in  other  people's  way. 


A-2 


DISTRIBUTION  I,  I ST 


Principal  Deputy  Assistant  Secretary  of  the  Navy  (Manpower  and  Reserve  Aflairs) 
Chief  of  Naval  Operations  (OP-01 B) , (OP-OICR) , (OP-964D),  (OP-987H),  (OP-991 B) 
Chief  of  Naval  Personnel  (pirs-lOc).  (Pers-2B) 

Chief  of  Naval  Material  (NmAt  08T244) 

Chief  of  Naval  Research  (Cod^  450)  (4) 

Chief  of  Information  (01-2252^ 

Director  of  Navy  Laboratories'. 

Commandant  of  the  Marine  Corps  '(Code  MPI-20) 

Chief  of  Naval  Education  and  Training  (N-5),  (N-2),  (00A) 

Cliief  of  Naval  Technical  Training  (Code  016),  (Code  N3) 

Chief  of  Naval  Education  and  Trailing  Support 

Chief  of  Naval  Education  and  Training  Support  (OplA) 

Commander  Training  Command,  U.  S.  Pacific  Fleet  . 

Commander  Training  Command,  U.  S.  Atlantic  Fleeyt  (Code  N3A) 

Strategic  System  Project  Office  (SP-1,5)  / 

Commanding  Officer,  Fleet  Combat  Trailing  Centfer,  Pacific  (Code  00E) 

Commanding  Officer,  Fleet  Training  Center,  Sari  Diego 

Commanding  Officer,  Fleet  Anti-Submarine  War/are  Training  Center,  Pacific 
Commanding  Officer,  Naval  Education  and  jlra/ning  Program  Development  Center  (2) 
Commanding  Officer,  Naval  Development  aniKTraining  Center  (Code  0120) 

Commanding  Officer,  Naval  Damage  Control  Training  Center 
Commanding  Officer,  Naval  Education  and  Tinning  Support  Center,  Pacific 
(Code  NIB)  / \ 

Commanding  Officer,  Naval  Health  Science!  Education  and  Training  Command 
(Code  2)  (2)  / \ 

Commanding  Officer,  National  Naval  Dental  Cent\r  (Library) 

Commanding  Officer,  Naval  Training  Equipment  Cater  (Technical  Library) 
Commanding  Officer,  Naval  Technical  Tdftining  CeiVer,  Treasure  Island 
Commanding  Officer,  Underway  Repleni siment  Schoo^  Naval  Technical  Training 
Center,  Treasure  Island  / \ 

Officer  in  Charge,  Naval  Education  a/d  Training  Information  Systems 
Activity,  Memphis  Detachment  / \ 

Officer  in  Charge,  Naval  Instructional  Program  Development  Detachment, 

Great  Lakes  f \ 

Director,  Training  Analysis  and  Evaluation  Group  (TAE^) 

Master  Chief  Petty  Officer  of  the  Force,  U.  S.  Atlant i\ Fleet 

Master  Chief  Petty  Officer  of  the  Force,  U.  S.  Pacific  ^Leet 

Master  Chief  Petty  Officer  of  the /Force,  Naval  Material  (\mmand  (NMAT  00C) 

Master  Chief  Petty  Officer  of  the; Force,  Naval  Education  aid  Training 

Command  (Code  003)  , \ 

Personnel  Research  Division,  Air  Force  Human  Resources  I^ibomtory  (AFSC), 

Brooks  Air  Force  Base  \ 

Technical  Library,  Air  Force  Humnn  Resources  Laboratory  (AFSC\,  Brooks 
Air  Force  Base  ' \ 

CNF.T  Liaison  Office,  Air  Force  Human  Resources  Laboratory,  V 

Williams  Air  Force  Base  \ 

Commandant , National  Defense  University,  Industrial  College  of  the 
Armed  Forces 

Military  Assistant  for  Training  and  Personnel  Technology,  Office  of  the 
Under  Secretary  of  Defense  for  Research  and  Engineering 
Director,  Defense  Activity  for  Non-Tradit ional  Education  Support 
Secretary  Treasurer,  II.  S.  Naval  Institute 
Science  and  Technology  Division,  Library  of  Congress 
Defense  Documentation  Center  (12) 


Fleet 


id  Training 


